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ABSTRACT 

The challenge of better reconciling individual and collective aspects of innovative 
problem-solving can be productively addressed to enhance the role of PBL as a key 
focus of the creative process in future higher education. This should involve ‘active 
learning’ approaches supported by related processes of teaching, assessment and 
curriculum. As Biggs & Tan (2011) have suggested, an integrated or systemic approach 
is needed for the most effective practice of outcomes-based education also especially 
relevant for addressing relatively simple as well as more complex problems. Such a 
model will be discussed in relation to the practical example of a Masters subject 
conceived with interdisciplinary implications, applications, and transferability: 
‘sustainable policy studies in science, technology and innovation ’. Different modes of 
PBL might be encouraged in terms of the authentic kinds of ‘complex problem-solving’ 
issues and challenges which increasingly confront an interdependent and changing 
world. PBL can be further optimized when projects or cases also involve contexts and 
examples of research and inquiry. However, perhaps the most crucial pillar is a model 
of portfolio assessment for linking and encouraging as well as distinguishing individual 
contributions to collaborative projects and activities. 
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INTRODUCTION 

Once described as a. foundation or linear structure, knowledge today is depicted as a network 
or a web with multiple nodes of connection, and a dynamic system - Julie Thompson Klein 
(2004), Interdisciplinarity and complexity: An evolving relationship, E:CO, 6, 1, p.2 

In the 21 st Century in a fast-changing, complex and often difficult world of endless challenges 
and accelerating crises people have to increasingly deal with what many are calling ‘wicked 
problems’ (e.g. Kolko, 2011) - that is, complex problems without any obvious simple 
solutions requiring greater collaboration and the linking of different areas or disciplines of 
knowledge. In this way it is no longer good enough for universities to merely reproduce 
knowledge as merely surface learning or descriptive research (Trilling & Fadel, 2009). 
Problem-solving is the basic human impulse to actively engage in changing and improving 
human knowledge in the adaptation to changing global as well as local contexts of relevance 
and importance (Armstrong, 2012). On one hand this may involve science and technology 
responses to increasingly complex adaptations to physical environments. On the other hand, 
from rather a human or social science perspective this may also involve social, political and 
economic as well as the cultural as well as cognitive human contexts of communities, 
organizations, and whole societies trying to balance both internal imperatives and external 
challenges. 

Philosophers such as Karl Popper and Bertrand Russell have long stressed the sophisticated 
ways in which problem-solving can or should be generally linked to the thinking process and 
methods of inquiry. However, as Socrates (whose elenchus method was a prototype for 
modern scientific methodologies) long ago pointed out, a problem-solving approach to 
thinking is one which is potentially open to anyone (or any learner) to negotiate the 
implications and omissions of the perpetual gaps between human knowledge and ignorance 
(Paul & Elder, 2004). In short, any kind of human problem-solving process is also inevitably 
a creative learning process - a key reason why formal education can be so readily transformed 
or effectively enhanced by problem-based learning approaches. The links between a systems 
perspective, the creative process and the problem-solving impulse in various forms of human 
knowledge were usefully described in Arther Koestler’s (1963) model of the common 
structure of ‘artistic originality, scientific discovery, and comic inspiration’. His bisociation 
model recognized that systems are always both part of larger systems and made up of endless 
smaller systems. In terms of human concepts, metaphors and perceptions such systems of 
representation are both internally open to transformation as well as also in relation to the 
knowledge of nature or adaptation to external challenges and environments. From an 
educational perspective this can perhaps be appreciated rather in terms of the interplay of 
surface vs. deep learning modes (e.g. Biggs, 1999) as a similar or related threefold creative 
process at distinct levels of form (or content), explanatory synthesis involving both cognitive 
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and social domains, and innovative solutions applied within particular contexts or transferable 
beyond this. 

Problem-based learning (PBL) is a developing movement in international universities with 
interdisciplinary as well as specialist implications for a diverse range of disciplines and 
knowledge areas besides the medical schools where it originated as a formal method of using 
authentic cases (Barrows & Tamblyn, 1980). As a concept the term has been further adapted 
as a generic approach to active or constructivist approaches to learning in schools as well as 
universities (e.g. Jonassen et al, 2003). In this way it has been linked to related notions of 
self-directed outcomes (Biggs & Tan, 2011), critical thinking or inquiry (Paul & Elder, 2004), 
and also notions of the collaborative or social learning of ‘communities of practice’ (e.g. 
Wenger, 1999). However it is useful to consider how problem-based learning exemplifies 
what many call ‘higher-order’ and others ‘deep-level’ notions of learning applicable to 
practical as well as conceptual or theoretical domains. This is in contrast to the lower or 
surface notions of learning as the mere transmission, reproduction or even imitation of content 
in the form of information or basic skills (Bailley, Hughes & Moore, 2003). In this way as a 
model of active or constructivist learning and knowledge inquiry, PBL has long also 
exemplified the challenges and resistances to traditional educational models of exam-based 
assessment and an associated teacher-centred pedagogy as well as ‘transmission’ curriculum 
(Hmelo-Silver, 2004). 

In this paper we discuss a systems approach to problem-solving in general as well as to 
problem-based learning in particular. In terms of how PBL exemplifies the possible links 
between formal education and the pivotal human capacity for problem-solving, we further 
discuss how this also presupposes a related systems approach to better integrating methods or 
designs of pedagogy, curriculum and assessment as well as the learning process. The 
discussion below will be organised around two related sections. The first section will look at 
the link between PBL and a systems view of the distinction between simple and complex 
problem-solving. The second section will use a practical example to discuss how PBL might 
be recognised and applied as one of three central pillars of ‘active learning’ in terms of an 
integrated application also to curriculum design, assessment methods, and the learning 
process. This example from a Masters program provides a focus for exploring the 
convergences between outcomes-based research and learning. 


THE IMPLICATIONS FOR PBL OF A SYSTEMS VIEW OF THE DISTINCTION 
BETWEEN SIMPLE AND COMPLEX PROBLEM-SOLVING 

Deriving in particular from Van Bertalanffy’s (1974) model of general systems theory, 
various related models of systems thinking or science share in common an interdisciplinary 
approach to or perspective on the link between different areas of knowledge. Most significant 
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is how such theories or models are not only typically seen as applicable to both natural and 
human or social realms of knowledge but a means of linking what Bateson (1979) called the 
‘the necessary unity... mind and nature’. Thus the key concepts of an emerging paradigm of 
‘complex adaptive systems’ and related models of complexity theory have also encompassed 
social or human domains of science as well as the physical sciences. 

Such a paradigm has encompassed notions of feedback, emergence, self-organisation, and 
homeostasis or dynamic equilibrium in natural systems of physical matter, chemistry, and 
biology (e.g. Laszlo, 1972, Prigogine & Stengers, 1984, Mandlebrot & Hudson, 2005) on one 
hand, and on the other corresponding notions of life cycles, supply chains, and change 
dynamics in various forms of human organization involving complex social, economic and 
cultural imperatives (e.g. Forrester, 1991; Barratt, 2006). The related importance then of 
multi-disciplinary collaboration and interdisciplinary problem-solving (Klein, 2006) to 
complement rather than oppose content knowledge specialization is thus reflected by how 
human organizations also function as naturally complex adaptive systems in relation to 
changing environments (e.g., Mitleton-Kelly, 2003). In other words, there is a natural 
connection between systems theory and the inevitably interdisciplinary as well as 
interdependent requirements of complex problem-solving in and across all areas of human 
knowledge (Fauconnier & Turner, 2002). 

Scientific and other models of knowledge are often viewed in terms of mere data and 
information accumulation but the human capacities for observation and reflection as well as 
experimentation in relation to new or changing contexts are clearly more effective when 
framed as focused problem-solving of some kind. This is so in relation to how a problem is 
perhaps most usefully defined as a ‘perceived gap between the existing state and a desired 
state, or a deviation from a norm, standard or status quo’ (Business Dictionary, n.d.). A 
systems approach or perspective allows recognition that all human problems either directly or 
indirectly involve systemic complexity - even apparently simple problems. In contrast to the 
tendencies of superstitution (confusions of wholes with some of their parts) and various 
forms of typically de-contextualized or modem modes of positivism, reductionism and 
‘either-or’ thinking (which reduces wholes to the sum of their parts), systems theory focuses 
on the interdependent as well as independent relation of wholes and parts in and across 
distinct systems in terms of the processes of interaction, change and transformation. 

As we have put it elsewhere (Richards, 2013, p.6): 

Simple problems (e.g. a bacterial infection, a clogged up fuel filter, or a 
personality clash within a business organization) which may initially seem more 
serious and complex might well be quickly addressed and efficiently resolved. 
However good doctors, mechanics, and leaders all know that both simple and 
complex problems are all ultimately about restoring the natural and deep-level 
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efficiency or health of a particular ‘system ’ whether this be a patient, a car or a 
business organization. As the wicked problem concept illustrates, the world of 
actual human experience and organization as well as all nature generally is 
ultimately and intrinsically complex, interdependent, and open to perpetual 
change. Superficially ‘simple’ problems ever conceal a latent complexity, yet 
ostensibly ‘complex’ problems are ultimately quite simple in principle. 


Figure 1. A systems model of complex problem so lving 
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Figure 1 outlines a systems model of complex problem solving we have developed and used 
to assist the planning of students in the course discussed below. It represents the three basic 
stages of addressing a complicated, difficult, and even an apparently impossible problem or 
challenge. Assuming that it has been established that we are dealing with a systemic or 
complex and not just superficial challenge or minor issue, the foundation stage then is to 
recognize and prioritize the various aspects of an identifiable problem of some kind. The main 
aim at this stage is to identity the key factors which might include both internal and external 
aspects, factors and ‘variables’. The second stage involves investigating and coming up with 
possible distinct remedies to each of the main contributing factors, as well as some macro 
remedies to the main problem. The third stage then is to consider an overall formula which 
makes use of also distinct ‘contributing solutions’. Such a synthesis will also consider how 
these supporting remedies might combine together in a strategic way to be part of an overall 
solution. As well as combinations of parts in space any overall solution must also incorporate 
the process of time to anticipate obstacles to any plan as well as productive interventions and 
requirements of implementation. The three stages also correspond to Ricoeur’s (1994) 
hermeneutic arc of an initial situation or ‘naive’ awareness giving way to critical or 
explanatory deconstruction then followed by an applied or dialogical stage of synthesis, 
reconstruction, or transformation. 
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igure 2. A knowledge-building approach to the challenge of complex problem-solving 
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What are the key elements and general approach needed to ensure Malaysia has a robust, 
integrated and sustainable water policy framework in order to help meet the aspiration of 
achieving developed country status by 2020? 

What are the key issues at stake in the Malaysian context, and 
does the Malaysia situation compare with other 
countries in terms of the challenges of coming up with a 
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What are the most important or critical factors to be 
addressed to balance increasing human needs for water and 
changing environmental condition (extreme weather, etc )? 


What are typically the kinds of factors and issues 
which need to be addressed by any country wanting 
to develop a sustainable water policy? 


Background context/rationale : Since the mid-2000s, the Malaysian water sector has been in a state of transition as 
various reforms have attempted to pave the way for greater ‘efficiency, conservation and cost effectiveness'. Despite these 
reforms, there is a lack of an overarching national water policy framework which would provide strategic guidance on 
long-term sustainability of the sector. A national framework is long overdue considering endemic sectoral challenges such 
diminishing water resources, high leakage rates, degradation of water catchments, flooding, historical low water tariffs, 
and high ly politicized govern ance. A national water policy framework could be introduced to support exist ng industry 
reform (i.e. National Water Services Act 2006) whilst learning from the approaches taken by other countries. This 
framework would be appropriate to the local environment by being sensitive to the unique issues faced in Malaysia 


Figure 2 further outlines an example of emergent outcomes-based rather than merely 
retrospective or rationalist evidence-based inquiry and problem-solving. It adopts the 
constructive version of the applied or dialogical hermeneutic ‘law of three’ to outline a 
practical example of formulating a framework for addressing ‘wicked problems’. The initial 
phase involves achieving a provisional or working foundation. On this basis a second stage 
seeks to prioritize the various relevant internal and external factors or contributing problems. 
Following on from or simultaneous to this, a third phase seeks to develop an emergent and 
convergent solution. The implied strategy then is to ‘optimize’ the problem-solving process in 
terms of transforming any relevant data and information into applied knowledge and 
understanding. As the right-hand diagram in Figure 2 illustrates, an integrated, optimal and 
sustainable approach to addressing a central or focus problem can be designed in terms of a 
knowledge-building structure which establishes a relevant foundation, is able to progressively 
prioritize related issues, and further facilitates not only the acquisition of data and information 
but its transformation into useful knowledge. 

This might be appreciated in terms of recognising the interplay of internal and external axes 
of inquiry which together constitute the so-called data-information-knowledge-wisdom 
pyramid (see Figure 3) used in such areas as ‘management information systems’ (e.g. Fricke, 
2009). In such applications ‘wisdom’ is typically seen as unknowable or referred to only 
ironically. The accumulation and description tendencies of an external axis of empirical data 
and organised/rationalized information is redeemed or open to be transformed in terms of 
some focus outcome in relation to an internal axis of knowledge, experience, and 
understanding. In this way ‘wisdom’ need not be an accidental by-product or outcome of 
accumulation and complexity but actually a deep foundational process based on the quality of 
experience, understanding, and interpretation not just quantity of information (Richards, 
2011 ). 
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Figure 3. Thinking for problem-solving - the basis for transforming emergent databuilding 
into productive knowledge-building 
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Figure 4 outlines a model for a paradigm shift from the linear and hierarchical assumptions of 
transmission and related reproductive learning models which tend to focus on the surface 
acquisition of skills or information. It further projects how an outcomes-based education 
approach aims to encourage deep learning outcomes associated with active or constructivist 
learning models (Spady, 1993). Unfortunately this is often understood or applied as a merely 
hopeful anticipation of the future often inadequately supported as an actual process of 
emergent knowledge building. As Biggs & Tang (2011) have pointed out, a really effective 
outcomes-based education approach works backwards from concrete notions of proficient and 
transferable performance in specific contexts to emphasize the crucial elements of 
pedagogical, curriculum and assessment design to support this as an actual process of 
emergent knowledge building. In this way also, we find it useful to make the distinction 
between conventional Teaming objectives’ curriculum design and teaching on one hand, and 
on the other a truly ‘outcomes-based’ approach. This may be explained in terms of a related 
distinction between golf hackers who aim for the flag in a merely hopeful way (a vague or 
hopeful objective) and those try to align their game with a concrete visualization of the 
required length, direction and trajectory (clarify, frame, and ‘work back’ from a specific 
outcome) for the ball to ‘go in the hole’ as many golfing coaches now teach professionals 
(Gallwey, 2009). For outcomes-based education to work properly, learning activities need to 
be sufficiently aligned in practice with the process not just metrics of assessment or 
evaluation. Likewise the formative aspects of the assessment as well as learning process need 
to be sufficiently encouraged and also aligned with the rationale and framework of summative 
assessment procedures. This is why project work and other ‘culminating’ modes of learning 
activity are so useful in facilitating more systemic or deeper modes of learning. 
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Figure 4. How outcomes-based education should ‘reverse’ not reinforce conventional and 
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As indicated above, active or constructivist models of deep learning also often and generally 
emphasize an associated alignment of related axes of critical thinking and applied 
performance when building upon or transitioning from merely ‘surface learning’ modes. This 
is why exams may well remain a useful part of an integrated assessment strategy and should 
not be seen in an either-or relation to project work, assignments, and related modes lending 
themselves to encouraging active or constructivist learning. We have also elsewhere argued 
that related models of problem-based learning, inquiry-based learning and project-based 
learning represent the three key pillars of the various permutations of active or constructivist 
learning (Richards 2004). This is in part on the basis that these models also link together in 
ways that correspond well to the action learning (and ‘double loop’ learning) cycles of David 
Kolb, Donald Schon, and others (e.g. Kolb, 1984). Moreover, problems, questions and tasks 
framed in authentic or imaginary contexts of learning activity lend themselves to a related 
alignment between formative and summative assessment as well as of surface and deep 
aspects of the learning process. Notions of surface learning are typically associated with the 
reproduction of information or skills whereas deep learning is a mode of optimal performance 
or applied understanding transferable across different contexts (e.g. Biggs, 1999). 

Figure 5. The three pillars of active or constructivist learning translated into an emergent 
learning-assessment framework 
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The right-hand diagram in Figure 5 thus depicts how a culminating learning task or activity 
provides the focus and structure for developing a foundation for optimal and sustainable 
learning application or performance on one hand, and on the other a macro-micro interplay of 
ideas and language aspects synthesized in any creative thinking process. The left-hand 
diagram correspondingly suggests how a three pillars model of active learning also reflects 
Ricoeur’s dialogical model of three distinct stages in emergent knowledge-building - a naive 
stage ( identifying and/or posing a relevant problem ), a crucial stage ( translating this into a 
focus question ), and an applied or dialogical stage ( building knowledge or achieving deep 
learning as a an emergent phase of project development). Thus applicable to any model of the 
transition from surface to deep learning is Ricoeur’s (1994) related theory of innovation. It 
posits that ultimately any human performance or communication of meaning can either 
potentially or actually go beyond (surface) learning as accumulation or linear progression to 
creatively open up existing social as well as personal or individual structures to 
transformative change or improvement. 

There are different applications of PBL in different areas of knowledge or for distinct 
outcomes. Some versions of PBL are promoted in terms of specific cases involving 
specialized knowledge (e.g. the use of PBL cases in medical education) whereas as others 
espouse interdisciplinary or ‘across-the-curriculum’ collaborative learning (Jonassen, et al, 
2003). However, either directly or indirectly PBL designs or approaches can most effectively 
enhance learning where some form of ‘problem-solving’ is linked to an alignment of focused 
outcomes and meaningful culminating activity. As Kolb (1984) suggests, the most effective 
cycle of learning involves active experimentation linked to concrete experience as well as to 
related processes and stages of reflective observation and abstract conceptualization. In 
related fashion, models and practices of PBL can and should replicate the applied problem¬ 
solving experimentation in the natural and also medical sciences as well as the thought 
experiments of the human and social sciences. In other words, it might be suggested that the 
most effective convergent notion of PBL is typically conceived in terms of either authentic or 
imaginary ‘problems’ framed in a variety of ways including cases, scenarios, questions, 
challenges, issues, and so on. 

As Biggs & Tan (2011) outline, outcomes-based learning and assessment should be 
constructively aligned to provide a supporting framework designed to assist learners to 
achieve specific learning outcomes aligned with various activities and processes of active or 
constructivist learning. Inadequate applications of the outcomes-based education model tend 
to merely confuse outcomes with objectives and also ignore how there should be a crucial as 
well as constructive alignment of meaningful and effective outcomes with not only learning 
activities and processes but the formative as well as summative process of assessment. The 
conventional view of lesson-planning, syllabus design, and curriculum development has 
tended to emphasize linear and hierarchical content-focused models of skills or information 
acquisition. But active learning models rather emphasize the importance of interesting and 
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engaging introductory contexts which also link to a process of knowledge synthesis and 
application in examples (or cases) - emphasizing the importance of an integrated process of 
learning which also links reflection and activity. Thus a systems view and application of 
outcomes-based education should promote assessment for and not just of learning. It should 
also provide an integrated and structured educational but also inquiry ‘space’ (and not just 
classroom ‘environment’) for the emergent of effective learning as both understanding and 
explanation in terms of an effective linking also of macro level concepts, attitudes and general 
knowledge together with more micro level skills, content and detailed modes of knowledge. 
Good teaching and curriculum design should promote and encourage deep and not just surface 
learning transferable to other contexts. A systems approach, then, is particularly useful in 
promoting different yet related modes of deep learning. 


WICKED PROBLEMS AND POLICY-BUILDERS OF THE FUTURE? 
CURRICULUM AND ASSESSMENT DESIGNS TO SUPPORT AUTHENTIC 
PROBLEM-BASED LEARNING FOR AUTHENTIC POLICY CHALLENGES OF 

SUSTAINABILITY 

PBL has been particularly discussed above in terms of its application to promote assessment 
for and not just of learning. Various kind of authentic or imaginary learning ‘problems’ can 
either directly or indirectly encourage and support an associated mode of effective outcomes- 
based learning. We discuss below a recent example where we had the opportunity to apply a 
systems approach to teaching, curriculum and assessment within a completely new course. 
The module MFT1053 Sustainable STI Policy Development was unexpectedly added at the 
last moment to the initial 2012 offering of a new Masters program (Richards, 2012). Short 
notice was received to conceive and develop this. However it was clearly a course which lent 
itself to a PBL approach with its focus on the challenge of sustainable policy studies linked to 
the similarly important concept of ‘science, technology and innovation’ (e.g. Christensen, 
1997, Meissner, Gokhberg, & Sokolov, 2013). 

We will discuss below three aspects of how we applied a PBL framework relevant for this 
particular course in relation to a similarly ‘systems approach’ to encouraging an authentic 
problem-solving orientation for authentic purposes linked relevant or possible cases, 
challenges, and issues which students could choose to focus on. The first section will outline 
how students were required to undertake a course project in pairs where they needed to 
identify, address and design a possible working solution to some distinct and authentic 
problem related to issues of sustainability also linked to aspects of science, technology and 
innovation. The second section will discuss how this was encouraged and framed in relation 
to a digital portfolio assessment context also involving related reflections and activities done 
individually to reflect, support and link to the culminating project and the related achievement 
of projected course outcomes. This involved an innovative yet effective assessment 
framework applied as a mark-sheet which, for space reasons, could not be included here. A 
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third section indicates one of many conceptual tools used in this class which epitomizes an 
outcome-based approach to ‘integrated, optimal and sustainable’ complex problem-solving. 


Designing a problem-based learning project task in sustainable STI studies 
The integrated program of teaching, curriculum and assessment in this course was built 
around the student development of a project involving a relevant focus problem. The classes 
of MFT1053 were conducted as a set of regular presentations linked to related tutorials. In 
addition to weekly presentations on course topics, each week students were required to 
individually present seminars on a topical new case of a policy problem authentically derived 
from the local newspapers. In this way they were asked to identify interesting and exemplary 
STI-related policy problems of sustainability and also came up with initial suggestions of 
possible solutions. These presentations then were linked to tutor-lead discussions, and online 
as well as face-to-face class activities. For their presentations as for their main project, 
students were expected to produce a ‘knowledge-building pyramid’ which consisted of the 
translation of their chosen policy problem into an inquiry rationale as the basis for also 
identifying and engaging with a central question in terms of three supporting questions which 
might structure the inquiry towards emergent solution options. This regular linking of 
practical, interesting and authentic cases to aspects of theory, evaluation and the construction 
of design solutions became the foundation for students to later take on a more developed 
project which functioned as a culminating task synthesizing the stages and aspects of 
sustainable policy development as complex problem-solving in this particular subject. 


Figure 6. Summary overview version of MFT1053 project task 
MFT1053 Science, Technology and Innovation Sustainable Policy Development 
Project - STI Case Study in sustainable policy-building [revised] 40% 

Class topics and activities will aid with the skills, knowledge and procedures to undertake a detailed case study 
of a chosen topic. Students will be asked to structure their project around provided templates which will assist to 
develop two stages of STI policy-building: (a) identifying a particular STI Policy challenge, issue or problem, 
and (b) outlining a provisional strategy of sustainable planning or decision-making to address this. The project 
may be developed as a collaboration in pairs harnessing the power of cooperation and team-work as well as 
individual insight and applications. The chosen example should have at least some indirect connection to an 
aspect of focus of ‘science, technology and innovation’ and also the need for some kind of policy-building 
collaboration between organizations or interests from government, private/commercial, community and/or 
university (R&D) domains. For instance... 

1. Exemplary higher education - industry - government - society collaborations involving both aspects of 
(a) science and technology and (b) sustainable policy-building implications. 

2. Authentic social and/or environmental issues, problems and challenges which might be most effectively 
addressing with an integrated approach to linking ‘science and technology’ to knowledge management or 
organizational strategies of planning and decision-making 

3. Harnessing and applying existing science and technology to address social and/or environmental challenges 
or problems (and/or associated economic challenges/business opportunities) 

4. Exemplary instances of cutting edge/future ‘science and technology’ (bio/nano-technology, renewable 

energies, digital technologies, etc.) with sustainable policy-building implications (e.g. green technology, 
sustainable development, innovation economy, & commercialization of research) General Criteria: project 
development, teamwork (if done in pairs), case study analysis and application, innovation of policy solutions, 
demonstration of ‘sustainable ' policy-building, _ 
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Figure 6 outlines how students were provided with options and supporting templates to 
support the development of their project inquiry in terms of three stages and corresponding 
parts of their required project write-up: (a) identify a brief rationale, background and 
supporting inquiry structure to address the selected policy issue or challenge; (b) critically 
break down a central problem of selected policy issue into main contributing aspects, 
elements and factors, and (c) design and outline a proposed sustainable solution which would 
simultaneously address contributing challenge and central problem. The PBL project was 
expected to build upon the course foundations of ‘sustainable STF knowledge, case studies, 
and applied problem-solving. In this way it should represent a culminating activity of the 
overall course encouraging students to synthesize and apply what they have learnt so far in 
terms of projected key course outcomes. 

As indicated, sustainable policy studies linked to the emerging field of science, technology 
and innovation includes options which range from more specialized perspectives to 
interdisciplinary modes of complex problem-solving. Students were provided with models 
and templates to assist with this in terms of a how a sustainable problem-solving framework 
typically involves four distinct aspects and requirements or elements of integrated problem¬ 
solving and policy-building reflecting corresponding modes of human knowledge: 1. 
(communication, consensus and interdependence of) stakeholder perspectives; 2. knowledge 
management (of organizational vs. niche/individual/local human resources and performance) 
3. science and technology innovations (applied knowledge building as extension); and 4. 
complex environmental adaptation (to changing natural vs. socio-economic contexts in time). 
These aspects provide the focus for outcomes-based problem-solving geared towards the 
‘optimization’ of natural and human resources, an innovative as well as green approach to 
new science and technology solutions, and the process of achieving a foundation for 
sustainable ‘change and improvement’ in terms of a sufficient consensus of common 
purposes. As outlined such an approach requires a systemic alignment of the distinct if 
ultimately convergent axes of human knowledge-building. Students did not directly apply this 
framework in their projects but could use it to develop their selected problem focus in relation 
to the provided options. 

Activity-reflection e-portfolios as an overall ‘culminating task’ 

As the culminating course task of problem-based learning, the MFT1053 project undertaken 
was also part of an overall e-portfolio assessment framework supported by a range of 
supporting individual reflections and activities. These had a formative as well as summative 
purpose in allowing progressive feedback to students about their achievement of course 
outcomes. The concept of an activity-reflection e-portfolio (Richards, 2005, 2013) builds on 
Kolb’s notion that the most effective learning is that which constitutes an interplay of thinking 
and doing involving meaningful tasks to also harness the power of digital media to support 
such learning. As suggested earlier, the possibilities of achieving ‘active learning’ modes as 
an extended process across a particular syllabus or academic context are most fully realized in 
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various kinds of project-based learning which involve the notion of a ‘culminating task’. In 
various forms of problem-based and inquiry-based learning conducted as an authentic task or 
even as imaginary role-play and scenario, the notion of a culminating task of assessment 
synthesizes as well as supports an educational ‘ecology’ of targeted or projected outcomes 
linked to a central outcome or culminating task. Whilst the presentation of some kind of 
portfolio of reflections as well as applied learning tasks can be sufficient in itself to encourage 
this, the most effective curriculum framework for such optimized learning is to construct 
some particular project outcome. 

Figure 7 below illustrates a sample activity-reflection e-portfolio from the MFT1053 course. 
In this particular course the e-portfolio involved a simple Word document saved as a html file 
with a hyperlinked file. Nonetheless it still provides a comprehensive and accessible learning 
profile in terms of formative as well as summative purposes tracking and archiving the related 
reflections and activities supporting the main project. Students are typically encouraged to 
develop such a profile into a professional e-portfolio beyond the purposes of the course. For 
assessment as well as feedback purposes, the e-portfolio further comprehensively maps and 
archives evidence of the outcomes achieved in the course. In particular this was organised as 
a mark sheet providing a portfolio of critical feedback in relation to key items whilst also 
applying a a formula for reconciling rubrics and criterion-based assessment and likewise 
converting qualitative indicators into an overall quantitative ranking. 

UTM MFT1053 class 


Figure 7. Sample activity-reflection e-portfolio profile from the 

MFT1053 Sustainable STI Policy Development 
Learning Portfolio - Name 

PersonaLProfessional profile 

E .is a student in UTM university in Malaysia. She 

is undertaking a Masters degree in Science, Technology, 
and Innovation Policy. Her prior academic study was a 
Bachelor degree in Chemistry. She has had about eight 
years of experience in international business 
management. 


Professional philosophy for sustainable policy-building and integrated problem-solving [developing 
sustainable solutions for STI-related policy problems or challenges] 

The concept of sustainable development is directed to provide a long-term vision for the society. For a community to 
function and be sustainable, the basic needs of its residents must be met. A socially sustainable community must 
have the ability to maintain and build on its own resources. It should also have the resiliency to prevent and or 
address problems in the future. There are two types or levels of resources in the community that are available to 
build social sustainability (and, indeed, economic and environmental sustainability) - individual or human capacity, 
and social or community capacity. By improving innovative and sustainable problem solving, we can help 
organizations to better identify and focus on those problems they need to solve. 


MFT1053 Collaborative project [with S.] 

Abstract: 

Social observers believe that obesity is an increasingly significant problem which needs to be be better dealt with in 
terms of public aw r areness. It is also a growing problem in Malaysia as w-ell as many other countries. A particular 
aspect of this problem which our project focuses on is the challenge of getting government to require that the 
labeling of packaged foods include more accurate information about ingredients and nutritional value. In other 
w'ords the policy challenge w r e w'ant to investigate is how more accurate labeling might assist with the promotion of 
public awareness about the importance of health and nutrition in general, and the challenge of obesity in particular. 

MFT1053 Project Artifacts 

1. Bookmark file including relevant folders and links of STI resources and case studies 

2. Project policy-building pyramid (and or other planning items) 

MFT1053 Reflections 

Week 2: Introduction to the sustainability dilemma: Discuss the related social and technological issues represented 

by the Lvnas Rare Earth Issue — and possible options for future directions with this. 

Week 5: Requirements of a more sustainable public-private sector collaboration [re: smartphone or w r ater industry 

examples discussed in class] 



Students were expected to submit regular reflections in response to provided focus questions 
throughout the semester. They did this by email in this particular course but could have 
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uploaded to an e-learning content management program. In this format they receive feedback 
and have the option to respond to this in the final version of the e-portfolio. In this course the 
series of reflections supported both the development of their main project and supporting 
activities. For instance, the Week 5 reflection asked students to respond to the following: 


Wk 5: 1. As various examples from the newspapers show, STI policy-building 
often takes places in relation to industry - government - society collaborations 
which may also involve universities (especially for R & D and 
education/training). A focus of this week's class is to look at the challenge of 
achieving sustainable collaborations. Briefly discuss how a more sustainable 
public-private sector collaboration might be needed or achieved in relation to 
either the smartphone or water industry examples discussed in class 


Students undertaking the MFT1053 course received weekly opportunities to consider possible 
solutions to authentic case studies in the challenges of achieving sustainable STI-related 
policy solutions. They were encouraged to adopt an outcomes-based problem-solving 
approach which thus lent itself very appropriately to the outcomes-based learning and 
assessment approach adopted within the educational framing of the course. As outlined in the 
first section of this paper this involved approaches which not only would seek to break down 
complex problems in terms of their key contributing factors but also consider possible 
outcomes solutions and the issues of integration and implementation which would be needed 
to support these. One such model applied which also integrated some of the key aspects of 
sustainable knowledge-building promoted in the course is outlined below. The enneagram 
model of ‘integrated, optimal and sustainable’ complex problem-solving promotes the notions 
of transformative as well as sequential or cumulative stages of inquiry. But it also provides an 
exemplary framework for designing an outcomes approach to problem-solving in terms of a 
systems perspective and model. 


‘ Integrated, optimal and sustainable ’ complex problem-solving: The enneagrammatic 
structure of any deep-level creative process 

The enneagram model represents a particular knowledge-building tool or method deriving 
from the Pythagorean tetractys which in its more recent adaptations has also been used for 
purposes of promoting effective organisational learning, strategic leadership, and applied 
decision-making as well as the integrated study of personality types (e.g. Riso, 1987; Blake, 
1996; Knowles, 2003). Such adaptations derive from the work of J.G. Bennett (1983) who 
saw the enneagram as an exemplary model of the complex (i.e. whole-parts) dynamic of the 
creative process. 
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As we have also discussed further elsewhere as part of a special journal edition focus on the 
transformative applications of the enneagram for organizational and other learning (Richards, 
2013), the enneagram also exemplifies the generic structure of natural and human systems of 
knowledge. The intrinsic properties of the enneagram represent a linking of both geometric 
progression and a ‘transformational’ view of numbers in terms of the Pythagorean conception 
of the base 10 system. The triangular relation of the 3-6-9 numbers representing integration, 
optimization, and sustainability frame the 1-4-2-5-7-8 sequence which also is the intrinsic 
decimal pattern of any seventh fraction. Our representation here links to a number of related 
terms of sustainable policy and knowledge building - notions of a ‘threshold of change’, a 
‘corridor of emergence’, and the challenge of achieving a ‘dynamic equilibrium’. 


Figure 8. The enneagrammatic formula of integrated, optimal, and sustainable problem¬ 
solving 


Targeted outcomes and 
'audience/stakeholders (in 
relation to a local context) 

Implementation dilemmas 
& intervention options 
[active/immediate choices, 
or 'experimentation'] 

Corridor of 
emergence 

Adaptation to complex& 6 
changing environments 
[external/knowledge-building 
axis] 5 

Plans, designs, 
strategies [macro 
decisions/ directions] 


Specific re-solution, 
universal application 

9 



An initial 'thread' of purpose 
or inquiry (self-organization/ 
innovation) 

Focus problem 
(linkinggeneral and 
particular aspects) 

2 Prioritize related 
issues/factors/ 
problems 

Develop an 'ecology of 
knowledge' [internal/ 
communication axis] 

Threshold of change 


A relevant foundation or 
framework [of change vs. 
micro details] 


Adapted from Richards, 2013 


However our interpretation of it here as a model for linking the related notions of resilient 
systems thinking, applied problem-solving, and the creative process of human knowledge¬ 
building also usefully represents two linked systemic stages of outcomes-based knowledge 
transformation. As Figure 9 indicates, the enneagram functions as an exemplary model of how 
self-organizing systems (especially those involving complex adaptation to changing contexts) 
typically involve internal or external axes of constructive alignment. In human social 
groupings and organizational dynamics this involves interdependent functions of 
accountability or self-organization and negative vs. positive feedback loops which converge 
to inform a resilient as well as transformational creative process. The related right-hand 
diagram indicates how it usefully exemplifies the corresponding processes of learning and 
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inquiry. A new paradigm of integrated, optimal and sustainable problem-solving in learning 
thus involves the emergent, deep-level, and higher order processes of optimal knowledge¬ 
building, reflected in the interplay of both macro and micro learning processes and outcomes. 
It thus exemplifies the potential of the most effective problem-based learning designs and 
structures in scientific inquiry, artistic representation, and an innovative performance of any 
practical skill or conceptual knowledge in context (Cf. also Pledge, 1983). 


Figure 9. The enneagram and the convergent axes of ‘unity’ which inform optimal human 
knowledge-building 


SYSTEM AXIS in time and space 


EXTERNAL 
SYSTEM AXIS 



INTERNAL 
SYSTEM AXIS 


‘unfreezing — 

Macro learning outcomes 

(attitude, accountability, 
resilience , etc.) 


Corridor of emergent l 
knowledge-building- 

(macro-micro ecology = 
generic skills) 


Micro learning outcomes 

particular skills, content and 
knowledge (also ‘metrics) 


Threshold —> ‘dynamic 
Of change equilibrium’(not 



Old paradigm: 
transmission to passive, 
reproductive learners; thinking 
vs. doing (theory vs. practice); 
content vs. skill transmission 


rence/aapiication OPTIMAL ^ 

'outcomes) AGENCY 


New paradigm: initiative, 
flexibility, problem-solving, 
resilience, strategy, patience, 
cross- cultural effectiveness, 
etc., 


Adapted from Richards, 2013 


CONCLUSION 

This paper has focused on how the natural human imperative for problem-solving in terms of 
adaptation to social as well as natural environments provides the key to the most creative as 
well as effective learning, inquiry and also knowledge-building research (Powell & Ryzhov, 
2012). It has discussed how the increasingly influential concept of problem-based learning 
has evolved in recent decades from its particular use in medical education for studying 
authentic cases to an interdisciplinary central pillar of the active or constructivist learning 
paradigm in schools and universities. The influence that a convergent PBL model has had on 
encouraging enhanced collaborative inquiry and problem-solving in professional as well as 
academic and even technical or competency-based education is also one that can and should 
be replicated in terms of more interdisciplinary, collaborative and outcomes-based (and not 
just evidence-based) inquiry within and beyond university contexts of partnership. After all. 
University students should ideally also learn in terms of active modes of thinking and 
knowledge-building applicable to both authentic real-life contexts and the additional 
university purpose of encouraging and supporting effective research in various senses of the 
term. 

A general model of PBL in primary and secondary education has typically encouraged cross- 
disciplinary collaboration and knowledge sharing (i.e. it is common for members of school 
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problem-based learning projects to take on different roles, purposes and modes of knowledge¬ 
building). This has not typically been the case in higher or continuing professional education 
contexts where the emphasis is often on specific cases in terms of specialized knowledge. The 
paper has developed an argument that a convergent model of PBL exemplifies as well as 
encourages the kind of approach needed to address the increasingly complex and diverse 
‘wicked’ problems facing the world in every aspect of both the social and natural domains of 
human life and activity. Thus the final section of the paper has outlined the cross-disciplinary 
inquiry implications of how a generic model of complex problem-solving systematically 
proceeds in terms of a basic three-stage method: (a) breaking down overriding or central 
problems into their main contributing domains and factors; (b) also focusing on these domains 
and factors separately as well as together in terms of seeking feasible or recommended 
supporting solutions, and (c) building towards an overall strategy and proposed integrated 
solution in terms of a systemic approach which reflects ‘the whole as well as the sum of its 
parts’. The further discussion of the enneagrammatic dynamics of ‘integrated, optimal, and 
sustainable problem-solving’ has served to exemplify the possibilities of an integrated 
systems approach to problem-based learning as well as the generic problem-solving process in 
every aspect of both social and natural domains of human knowledge. 
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